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FINAL  REPORT 


This  research  was  funded  from  April  90  -  March  92,  with  a  no  cost  extension  granted  till 
March  1993.  This  report  summarizes  the  research  results  that  were  obtained  primarily  during 
the  period  April  90  -  March  92.  Only  the  main  results  are  summarized,  and  for  the  details 
the  reader  is  referred  to  our  publications.  Also  included  at  the  end  of  the  report  are  the 
abstracts  of  the  publications. 

1  Problem  Statement 

The  main  focus  of  this  research  w as  determining  the  accuracy  of  subspace  based  methods  for 
estimating  the  Direction  of  Arrival  (DOA)  of  multiple  sources  from  measurements  obtained 
at  the  output  of  a  sensor  array.  Subspace  methods  like  MUSIC  (Multiple  Signal  Classi¬ 
fication),  ESPRIT  (Estimation  of  Signal  Parameters  via  Rotational  Invariant  Techniques), 
the  Minimum-Norm  methods  have  recently  received  much  attention,  and  their  estimation 
accuracy  as  well  as  a  rigorous  comparative  study  is  of  much  interest.  This  was  the  goal  of 
this  research.  Of  particular  interest  was  the  affect  of  spatial  smoothing  on  the  performance 
of  the  subspace  methods.  Spatial  smoothing  is  useful  in  dealing  with  coherent  sources  and 
for  the  possible  enhancement  of  the  performance  of  the  methods.  Also,  examined  were  the 
implementation  issues  associated  with  these  methods.  As  opposed  to  implementing  a  single 
algorithm,  implementing  a  signal  processing  task  which  consists  of  several  stages  on  special 
purpose  hardware  gives  prominence  to  the  interesting  issues  of  partitioning,  and  compos¬ 
ite  tasking,  which  are  examined  in  this  research.  We  believe  our  results  have  significantly 
improved  the  understanding  of  the  performance  of  subspace  methods,  and  have  lead  to 
interesting  insights  into  the  implementation  issues. 

2  Main  results 

Our  main  results  in  the  context  of  performance  analysis  of  spatially  smoothed  subspace  based 
methods  are  as  follows. 

•  We  have  established  a  general  framework  for  the  analysis  of  subspace  methods.  The 
usefulness  of  the  framework  is  that  it  is  simple  inspite  of  its  generality.  This  makes  it 
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possible  to  analyze  the  more  complicated  problem  of  performance  analysis  of  spatially 
smoothed  subspace  methods  Past  work  had  mainly  considered  subspace  methods  in 
the  context  of  no  smoothing. 

•  We  have  shown  that  the  forward-backward  covariance  matrix  is  better  conditioned  than 
the  forward  only  covariance.  This  provides  a  firmer  mathematical  basis  for  the  previous 
experimental  observation  that  forward-backward  approaches  have  better  performance 
than  forward  only  approaches. 

•  Expression  for  the  mean  squared  error  in  the  estimates  obtained  using  the  subspace 
based  methods  have  been  derived  and  compared.  Various  properties  of  the  estimators 
are  derived  based  on  these  expressions.  It  is  shown  that  spatial  smoothing  is  beneficial 
to  ESPRIT  and  the  Minimum-Norm  method,  and  that  their  performance  can  be  made 
comparable  to  MUSIC  by  proper  smoothing. 

•  Weighted  versions  of  these  subspace  methods  have  also  been  examined  and  optima] 
choices  for  the  weights  are  determined.  An  interesting  conclusion  is  that  the  perfor¬ 
mance  of  optimally  weighted  MUSIC  and  optimally  weighted  ESPRIT  are  the  same. 

•  Another  interesting  outcome  of  the  analysis  is  that  it  is  shown  that  the  analysis  can  be 
easily  applied  to  the  time  series  frequency  estimation  problem.  In  addition  to  providing 
a  unified  framework,  the  analysis  is  more  accurate  than  previous  analysis. 

In  the  context  of  implementation  issues,  the  problem  of  partitioning  becomes  an  important 
one  when  implementing  a  signal  processing  task  that  includes  a  number  of  stages.  It  is 
examined  in  great  detail,  and  new  scheduling  methods  for  the  Locally  Parallel  Globally 
Sequential  (LPGS)  technique  and  the  Locally  Sequential  Globally  Parallel  (LSGP)  technique 
are  developed.  A  flexible  scheduling  order  is  developed  that  is  useful  in  evaluating  the  trade¬ 
off  between  execution  times  and  the  size  of  storage  buffers.  The  results  are  revealing  and  lead 
to  many  interesting  insights.  For  example,  while  comparing  Givens  method  with  Housholder 
Transformation  (HT)  for  Least  Squares  problem,  it  is  shown  that  HT  is  superior  when  the 
matrices  are  large  compared  to  the  array  size. 
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Spatial  Smoothing  and  MUSIC  :  Further 
Results 

Bhaskar  D.  Rao  and  Iv.  V.  S.  Hari 
Department  of  AMES,  0411 

University  of  California,  San  Diego,  CA  92093-0411 

Abstract 

In  this  paper,  new  results  concerning  the  effect  of  using  a  spatially  smoothed  forward- 
backward  covariance  matrix  on  the  performance  of  MUSIC  for  the  direction  of  arrival 
'(DOA)  estimation  using  a  uniformly  spaced  linear  sensor  array  (ULA)  are  presented. 
Compact  expressions  for  the  asymptotic  mean  squared  error  in  the  estimates  of  the  signal 
zeros  and  the  DOA  estimates  are  derived.  Some  general  properties  of  the  estimates  are 
derived  which  lend  insight  into  the  effect  of  spatial  smoothing  and  the  forward-backward 
approach  on  MUSIC.  An  optimally  weighted  MUSIC  algorithm  is  also  presented  which 
minimizes  the  mean  squared  error  in  the  POA  estimate. 

1.  INTRODUCTION 

In  this  paper,  new  results  concerning  the  effect  of  using  a  spatially  smoothed  forward- 
backward  covariance  matrix  on  the  statistical  performance  of  MUSIC  [1]  are  presented. 
In  recent  years,  a  statistical  evaluation  of  MUSIC  has  been  conducted  by  a  number  of 
researchers  [2, 3, 4, 5, 6].  In  all  these  studies,  an  estimate  of  the  covariance  matrix  obtained 
by  straight  forward  averaging  of  the  outer  product  of  the  snapshots  was  considered.  Such  a 
covariance  estimate  is  not  suitable  for  coherent  environments.  As  a  solution  to  the  problem 
that  arises  with  coherent  sources,  the  idea  of  spatial  smoothing  was  suggested  [7,8].  In 
this  paper,  we  examine  the  effect  of  using  data  both  in  the  forward  and  backward  manner 
along  with  spatial  smoothing  on  the  performance  of  MUSIC.  An  analysis  of  MUSIC 
under  these  conditions  has  been  presented  in  [9,10,11].  The  results  in  this  paper  extend 
these  results  and  provide  more  tractable  expressions  which  provide  additional  insight  into 
MUSIC.  Compact  expressions  for  the  mean  squared  error  (MSE)  in  the  signal  zeros  as 
well  as  in  the  DOA  estimate  are  derived,  and  these  results  provide  a  better  understanding 
of  Root  artd  Spectral  forms.  It  is  found  that  for  MUSIC,  the  error  in  the  signal  zeros 
follows  a  different  trend  compared  to  the  error  in  the  DOA  estimates  leading  to  difficulty 
in  interpreting  the  spatial  spectrum.  Some  new  relationships  between  the  DOA  estimates 
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ABSTRACT 

In  this  paper,  results  concerning  the  effect  of  using  a  spa¬ 
tially  smoothed  forward-backward  covariance  matrix  on 
the  performance  of  State  Space  Methods/ESPRIT  for  the 
direction  of  arrival  (DOA)  estimation  using  a  uniformly 
spaced  linear  sensor  array  (ULA)  are  presented.  Compact 
expressions  for  the  asymptotic  mean  squared  error  in  the 
estimates  of  the  signal  zeros  and  the  DOA  estimates  are 
derived.  Some  general  properties  of  the  estimates  are  de¬ 
rived  which  lend  insight  into  the  effect  of  spatial  smooth¬ 
ing  and  the  forward-backward  approach  on  State  Space 
Methods/ESPRIT.  An  bptimally  weighted  State  Space 
Method/ESPRIT  algorithm  is  also  presented.  The  re¬ 
sults  indicate  that  by  properly  choosing  the  number  of 
subarrays  used  for  spatial  smoothing,  the  performance  of 
the  method  can  be  greatly  enhanced. 

1  INTRODUCTION 

Recently  a  statistical  evaluation  of  eigendecomposition 
based  State  Space  Methods/ESPRIT  was  conducted 
when  an  estimate  of  the  covariance  matrix  was  obtained 
by  straight  forward  averaging  of  the  outer  product  of  the 
snapshots  [1,2].  Such  a  covariance  estimate  is  not  suit¬ 
able  for  coherent  environments.  As  a  solution  to  the 
problem  that  arises  with  coherent  sources,  the  idea  of 
spatial  smoothing  was  suggested  [3,4],  Also  using  data 
both  in  the  forward  and  backward  manner  along  with 
spatial  smoothing  can  improve  the  quality  of  the  covari¬ 
ance  estimate  thereby  improving  the  DOA  estimate.  In 
this  paper,  we  analytically  quantify  the  effect  of  such  co- 
variance  estimates  on  the  DOA  estimates  obtained  using 
State  Space  Methods/ESPRIT.  Compact  expressions  for 
the  mean  squared  error  (MSE)  in  the  signal  zeros  as  well 
as  in  the  DOA  estimate  are  derived.  Some  new  relation¬ 
ships  between  the  DOA  estimates  obtained  from  the  var¬ 
ious  covariance  estimates  are  presented.  Based  on  the 
insight  gained  from  the  analysis,  an  optimally  weighted 
State  Space  Method/ESPRIT  is  also  developed  which 
minimizes  the  MSE  in  the  DOA  estimates.  A  more  de¬ 
tailed  treatment  of  this  subject  can  be  found  in  [5],  and 

•Thi*  work  w as  supported  by  the  ARMY  Research  Office  under 
Grant  No.  DAAU03-90-G-0095. 
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results  related  to  spatial  smoothing  and  MUSIC  can  be 
found  in  [6]. 

2  PROBLEM  FORMULATION 

2.1  Data  Model 

The  problem  of  estimating  the  direction  of  arrival  of  M 
possibly  coherent  plane  waves  incident  on  a  ULA  of  L\ 
sensors  is  considered  in  this  paper.  For  the  n  th  observa¬ 
tion  period  (snapshot),  the  spatial  samples  of  the  signal 
plus  noise  are  given  by  the  output  vector 

y(n)  =  [  yi (n)  ,  y7(n)  ,  ...  ,  yLl(n)  f  =  A»  +  N(n), 

where 

M 

**(")  =  P*(n) 

i=i 

and  w,-  =  —~—sin  9i,  d  being  the  separation  between  sen¬ 
sors,  A  the  wavelength  of  the  incident  signal,  and  9,  the 
DOA.  The  following  assumptions  are  made  regarding  the 
data  1 . 

A1  The  noise  vector  N(n)  is  assumed  to  be  a  zero  mean, 
complex,  white  circularly  Gaussian  random  vector, 
i.e.  N(n)  N(n)H  =  I  and  N(n)  N(n)T  —  0. 
It  is  also  assumed  to  be  independent  of  the  complex 
signal  amplitudes  p,(n). 

The  exact  distribution  of  the  source  amplitudes  p<(n)  and 
hence  that  of  AT(n)  turns  out  to  be  not  so  important  in 
characterizing  the  asymptotic  behavior  [5,7].  However, 
for  simplicity,  in  this  paper  the  following  assumption  will 
be  made. 

A2  The  complex  amplitudes  p,(n)  are  also  modeled  as 
being  zero  mean  circularly  Gaussian  random  vari¬ 
ables. 

The  covariance  matrix  of  the  amplitudes  is  P  whose  ele¬ 
ments  are  Piv  where  PXJ  =  [p,(n)p*(n)]. 

1  In  this  paper,  the  overbar  will  be  used  to  denote  the  ex¬ 
pectation  operator.  The  superscript  T  is  used  to  denote  transpose, 

*  to  denote  complex  conjugate,  H  to  denote  complex  conjugate 
transpose,  and  +  to  denote  the  pseudoinverse. 
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Abstract 

The  statistical  performance  analysis  of  Weighted  MUSIC 
and  Weighted  State  Space  Methods/ESPRIT,  for  the  di¬ 
rection  of  arrival  (DOA)  estimation  problem  using  a  uni¬ 
form  linear  array  is  presented  in  this  paper.  The  statis¬ 
tics  of  the  errors  in  the  subspaces  due  to  the  forward- 
backward  spatially  smoothed  covariance  matrix  estimate 
is  presented,  and  its  effect  on  the  weighted  subspace  meth¬ 
ods  is  discussed.  Based  on  the  analysis,  an  optimum 
weighting  matrix  minimizing  the  mean  squared  error  in 
one  of  the  DOA  is  derived.  It  is  shown  that  optimum 
weighting  improves  the  performance  of  the  subspace  meth¬ 
ods  and  makes  them  less  sensitive  to  the  choice  of  the 
sub-array  length. 

1  Introduction 


=  X(n)  +  A'(n), 

,  2rr  d  .  ...  .  .  . 

where  to,  —  —j—  sin#,,  d  being  the  separation  between 

sensors,  A  the  wavelength  of  the  incident  signal,  and  0, 

the  DOA.  The  following  assumptions  are  made  regarding 

the  data5 . 

A1  The  noise  vector  N(n)  is  assumed  to  be  a  zero  mean, 
complex,  white  circularly  Gaussian  random  vector, 
i.e.  N(n)  N{n)!l  =  cr2  /  ,  Ar(n)  N{n)T  —  0  and  is 
independent  of  the  complex  signal  amplitudes  p,(n). 

A2  The  complex  amplitudes  p,{n)  are  modeled  as  zero 
mean  circularly  Gaussian  random  variables. 

A3  The  N  snapshot  vectors  are  assumed  to  be  indepen¬ 
dent. 


In  this  paper,  results  concerning  the  effect  of  using  a  spa¬ 
tially  smoothed  forward-backward  covariance  matrix  on 
the  statistical  performance  of  Weighted  subspace  meth¬ 
ods,  weighted  MUSIC  and  weighted  State  Space  Meth- 
ods/ESPRlT,  are  presented.  Extending  the  analysis  of  un¬ 
weighted  subspace  methods,  compact  expressions  for  the 
mean  squared  error  (MSE)  in  the  signal  zeros  as  well  as  in 
the  DOA  estimate  are  derived.  Based  on  the  insight  gained 
from  the  analysis,  an  optimal  weighting  matrix  which  min¬ 
imizes  the  MSE  in  a  given  DOA  is  obtained. 

2  Problem  Formulation 


The  covariance  matrix  of  the  amplitudes  is  P  whose  ele¬ 
ments  are  Pt] ,  where  P,3  =  [/h(n)pj(n)].  Though,  the 
Gaussian  assumption  on  the  signal  amplitudes  (A2)  is  not 
essential  for  the  analysis,  it  isz-assumed  in  this  paper  for 
simplicity. 

2.2  Different  Covariance  Matrix  Estimators 

Some  of  the  popular  estimators  are  defined  below 
Forward  only  (F)  approach  :  In  this  approach,  an 
estimate  of  the  covariance  matrix  is  obtained  by  straight¬ 
forward  (lime)  averaging  of  the  outer  product  of  the  N 
snapshots2 


2.1  Data  Model 

« 

For  the  n  th  observation  period  (snapshot),  the  spatial 
samples  when  M  possibly  coherent  plane  waves  are  inci¬ 
dent  on  a  Uniformly  spaced  Linear  Array  (ULA)  of  L\ 
sensors  are  given  by  the  output  vector 


r(») 


I  vi(«)  i  viO>) ,  -  .  y/„(«)  ]r 


■  M  M 

£/>.•(«) . £/».(»0e 


1=1 


i=i 


>(Li  -  l)w, 


T 

+  flf(a) 


'This  work  was  supported  by  the  ARMY  Research  OfTiee  under 
Grant  No  DAAL-03-90-G-0095. 


=  77  E  Y(n)Y»(») 

1  n=\ 

Forward  only  Smoothing  (FS)  approach  : 

=  J-  i,  H’  tvhere  ftp  =  V  H  Yp(  n  )  YpH(  "  ). 

P-1  4  n=l 

’In  this  paper,  th?  overbat  will  be  used  to  denote  the  expec¬ 
tation  operator.  The  superscript  T  is  used  to  denote  transpose,  *  to 
denote  complex  conjugate,  H  to  denote  complex  conjugate  transpose, 
and  4-  to  denote  the  pseudoinverse. 

1  ‘is  used  to  denote  estimates 
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Abstract 

In  this  paper,  a  systematic  approach  for  the  analysis  of 
roundoff  noise  in  floating  point  digital  filters  is  presented. 
To  make  the  analysis  tractable,  a  high  level  model  to  deal 
with  the  errors  in  the  inner  product  operation  is  presented. 
Along  with  the  model,  an  efficient  procedure  to  keep  track 
of  the  addition  scheme  used  in  the  inner  product,  and  to 
compute  the  statistics  of  the  errors  is  introduced.  A  sys¬ 
tematic  procedure  based  on  the  model  is  then  developed 
to  derive  general  expressions  for  the  roundoff  noise  of  FIR 
and  IIR  filters. 

1  INTRODUCTION 

With  the  increasing  availability  of  floating  point  capabil¬ 
ity  in  signal  processing  chips,  insight  into  algorithms  em¬ 
ploying  floating  point  arithmetic  is  of  increasing  interest. 
This  paper  develops  a  systematic  and  tractable  procedure 
for  analyzing  roundoff  noise  in  digital  filters  employing 
floating  point  arithmetic.  The  related  problem  of  using 
fixed  point  arithmetic  and  their  effect  on  digital  filters 
has  been  extensively  studied  and  is  reasonably  well  un¬ 
derstood  [1,2, 3, 4,5].  The  analysis  of  floating  point  digital 
flters  has  also  been  studied  by  researchers  [6]-[l  1  ].  Unfor¬ 
tunately,  the  expressions  turn  out  to  be  cumbersome  and 
not  as  insightful.  Part  of  the  reason  for  the  difficulty  lies 
in  the  model  for  finite  precision  floating  point  arithmetic. 
Unlike  the  case  of  fixed  point  arithmetic,  where  the  round¬ 
off  errors  could  be  modeled  as  a  independent  white  noise 
sequences  independent  of  the  input  signal,  the  roundoff 
errors  in  floating  point  arithmetic  are  correlated  with  the 
input  signal  complicating  the  analysis  [7,6].  Also,  unlike 
the  fixed  point  case,  the  order  of  the  computations  has 
an  effect  on  the  roundoff  error.  Recently  in  [12],  it  was 
shown  that  use  of  the  Factored  State  Variable  Description 

‘This  work  was  supported  by  the  ARMY  Research  Office  under 
Grant  No.  DAAL'OY90-K~0095,  and  by  the  National  Science  Foun¬ 
dation  under  Grant  No.  MIP-87-J 1984. 


can  greatly  enhance  the  tractabilitv  of  the  analysis.  Also 
in  [13,14],  a  procedure  for  analyzing  roundoff  noise  based 
on  coefficient  sensitivity  analysis  is  presented. 

This  paper  examines  the  issue  of  output  roundoff  noise 
of  floating  point  digital  filters  with  a  view  towards  general¬ 
izing  previous  results  [15,7,6].  An  effective  way  for  dealing 
with  floating  point  inner  product  operations  is  presented. 
In  particular,  an  explicit  procedure  for  dealing  with  the 
effect  of  addition  schemes  is  provided.  Based  on  these  re¬ 
sults,  a  systematic  and  tractable  approach  foi  analyzing 
roundoff  noise  in  floating  point  digital  filters  is  presented. 
The  results  of  this  paper  arp  an  extension  of  our  earlier 
wmk  [16]. 

2  ERRORS  IN  FLOATING  POINT 
ARITHMETIC 

Throughout  this  paper  it  will  be  assumed  that  floating 
point  numbers  are  stored  in  the  form  {sign )/i.2i\  where  /i 
and  r  have  a  fixed  number  of  bits.  Also  it  will  be  assumed 
that  rounding  is  used  in  all  operations. The  notation  //{.) 
will  be  used  to  denote  the  machine  number  resulting  from 
floating  point  operation.  In  floating  point  operations  there 


are  errors 

in  both  additions  and 

multiplications  [7,6], 

i.e. 

fl(x  +  y)  = 

-  (t  + 

J/)(  1  +  0- 

(i) 

and 

=  xy{  i 

1  +  (). 

(2) 

and  -2"', 

<  t,f  <  2-’,  q 

being 

the  number  of  bits 

used 

to  represent  the  mantissa.  The  error  variables  i  and  b 
are  usually  assumed  to  be  random  variables  uniformly 
distributed  between  —  2~*  and  2~q.  The  error  variables 
have  zero  mean  and  variance  a}  —  =-y-.  Sometimes  a 
slightly  different  distribution  is  assumed  leading  to  a  vari¬ 
ance  a]  =  For  the  purposes  of  this  paper,  this  is 

not  critical  as  it  simply  scales  the  overall  noise  expres 
sions  derived.  The  above  basic/elementary  model  of  the 
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Abstract:  The  effect  of  using  a  spatially  smoothed 
forward-backward  covariance  matrix  on  the  per¬ 
formance  of  MUSIC  and  the  minimum-norm 
method  for  estimating  the  direction  of  arrival  of 
plane  waves  in  white  noise  using  a  uniformly 
spaced  linear  array  (ULA)  is  analysed.  In  particu¬ 
lar,  asymptotic  results  for  the  mean  squared  error 
>n  the  estimates  of  the  signal  zeros  and  the  direc¬ 
tion  of  arrival  are  derived.  It  is  shown  that  in 
general  for  subspace  methods  a  forward-back¬ 
ward  smoothing  approach  is  preferable  to  a  forward 
smoothing  approach.  An  important  outcome  of 
this  analysis  is  that  for  MUSIC,  the  error  in  the 
signal  zeros  is  shown  to  exhibit  a  different  trend 
compared  to  the  error  in  the  DOA  estimates  and 
this  leads  to  difficulty  in  interpreting  the  spatial 
spectrum.  For  instance,  when  smoothing  is  used, 
the  peaks  in  me  spatial  spectrum  become  sharper, 
giving  the  impression  of  higher  resolution, 
whereas  in  reality  the  estimates  of  the  DOA  may 
in  fact  have  deteriorated  compared  with  the  ones 
obtained  using  minimal  or  no  smoothing.  With 
regard  to  the  minimum-norm  method,  the  errors 
in  the  signal  zeros  exhibit  the  same  trend  as  the 
DOA  estimates  so  that  no  such  problem  is 
created.  As  to  the  relative  comparison  of  the 
methods,  it  is  shown  that  proper  spatial  smooth¬ 
ing  enables  the  performance  of  the  minimum- 
norm  method  to  be  made  comparable  to  MUSIC. 


1  Introduction 

In  this  paper,  we  analyse  the  effect  of  using  a  spatially 
smoothed  forward-backward  covariance  matrix  on  the 
statistical  performance  of  two  cigendecomposition-based 
methods,  MUSIC  [I]  and  the  minimum-norm  method 
[2].  For  better  understanding,  a  statistical  evaluation  of 
these  methods  has  been  conducted  in  recent  years  by  a 
number  of  researchers.  For  instance,  some  theoretical 
results  comparing  MUSIC  and  the  minimum-norm 
method  can  be  found  in  References  3  and  4,  wherein  the 
methods  were  characterised  by  examining  the  null  spec¬ 
trum.  More  recent  work  on  the  analysis  of  MUSIC  can 
be  found  in  References  5-7,  Our  recent  work  examined 
root-MUSIC  and  root-minimum-norm  in  detail  for  the 
uniformly  spaced  linear  array  (ULA)  case  [7,  8].  In  all 
these  studies,  an  estimate  of  the  covariance  matrix 
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obtained  by  straightforward  averaging  of  the  outer 
product  of  the  snapshots  was  considered.  Such  an 
approach  is  not  suitable  for  coherent  environments  As  a 
solution  to  this  problem,  the  idea  of  spatial  smoothing 
has  been  suggested  [9,  10].  Here  we  examine  the  effect  of 
using  data  both  in  the  forward  and  backward  manner, 
along  with  spatial  smoothing,  on  the  performance  of 
these  methods.  An  analysis  of  the  methods  under  these 
conditions  has  been  presented  in  References  11-13.  The 
results  in  this  paper  extend  results  of  these  references  and 
provide  additional  insight  into  the  methods.  Motivated 
by  our  earlier  results  [7,  8),  the  root  versions  of  these 
methods  are  examined  in  this  paper.  Expressions  for  the 
mean  squared  error  in  the  signal  zeros  as  well  as  in  the 
direction-of-arriva!  (DOA I  estimate  are  determined  and 
these  results  provide  insight  into  both  root  and  spectral 
forms.  It  is  shown  that,  in  general,  for  all  subspace 
methods  the  forward-backward  smoothing  approach  is 
preferable  to  the  forward  smoothing  approach.  The  error 
in  the  signal  zeros  obtained  using  MUSIC  is  shown  to 
follow  a  different  trend  compared  to  the  error  in  the 
DOA  estimates,  and  this  leads  to  diffkilty  in  interpreting 
the  spatial  spectrum.  On  the  other  hand,  it  is  shown  that 
for  the  minimum-norm  method  the  errors  in  the  signal 
zeros  exhibit  the  same  trend  as  the  DOA  estimates  so 
that  no  such  problem  is  created.  Also  it  is  shown  that 
proper  spatial  smoothing  enables  the  performance  of  the 
minimum-norm  method  to  be  made  comparable  to  that 
of  MUSIC.  Some  of  these  results  were  first  presented  in 
Reference  14  and  results  relating  to  spatial  smoothing 
and  state  space  methods/ESPRIT  can  be  found  in  Refer¬ 
ence  15. 


2  Problem  formulation 
2. 1  Data  model 

The  performance  analysis  of  subspace  methods  used  for 
estimating  the  directions  of  arrival  of  t  possibly  coher¬ 
ent  plane  waves  incident  on  a  ULA  of  Lj  sensors  is  con¬ 
sidered  in  this  paper.  For  the  nth  observation  period 
(snapshot),  the  spatial  samples  of  the  signal  plus  noise  are 
given  by  the  output  vector 

Y{n)  =  [>',(n),  y2(n) . yL,(n)]r 

MM  M  It 

IpM 

i  =  1  1=1  1=1 

+  N(n) 

=  X(n)  4-  N(n) 

where  Wj  =  (2nd//.)  sin  Q(,  d  being  the  separation  between 
sensors,  A  the  wavelength  of  the  incident  signal,  and 
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Abstract 


2  Problem  Formulation 


In  this  paper,  the  effect  of  spatial  smoothing  on  direction 
of  arrival  (DOA)  estimates  obtained  using  weighted  eigen- 
based  State  Space  methods/ESPRIT  is  analyzed.  Expres¬ 
sions  for  the  asymptotic  mean  squared  error  in  the  esti¬ 
mates  of  the  signal  zeros,  and  the  DOA  estimates  along 
with  some  general  properties  of  the  estimates  are  derived. 
It  is  shown  that  proper  choice  of  the  subarray  length 
can  improve  the  performance  of  the  method  significantly. 
Based  on  the  asymptotic  expressions,  an  optimum  weight¬ 
ing  matrix  minimizing  the  mean  squared  error  in  one  of 
the  DOA  is  derived.  „ 


1  INTRODUCTION 


2.1  Data  Model 

For  the  n  th  observation  period  (snapshot),  the  spatial 
samples  when  M  possibly  coherent  plane  waves  are  in¬ 
cident  on  a  ULA  of  L\  sensors  are  given  by  the  output 
vector 


y(n) 


•  M  M 

]LP.(n) . 

..=  i  i=i 

X(n)4  S{n). 


T 

■+•  A'  ( n ) 


27  d 

where  u,  —  — —  sin#,,  d  being  the  separation  between 
sensors,  A  the  wavelength  of  the  incident  signal,  and  6, 
the  DOA.  The  following  assumptions  are  made  regarding 
the  data1. 


This  paper  considers  the  effect  of  spatial  smoothing 
on  direction  of  arrival  (DOA)  estimates  obtained  using 
weighted  eigen-based  state  space  methods/ESPRIT  in  the 
context  of  Uniformly  spaced  Linear  Arrays  (ULA).  Analy¬ 
sis  of  the  method  for  the  forward  only  (no  smoothing)  case 
has  been  conducted  by  a  number  of  researchers  [1,2,3].  In 
[2,4,1],  it  was  shown  that  MUSIC  performs  better  than 
eigen-based  state  space  methods  with  the  difference  be¬ 
coming  significant  as  the  length  of  the  array  increases. 
However,  state  space  methods  are  computationally  more 
attractive,  and  it  is  desirable  to  see  if  this  deficiency  can  be 
overcome  by  using  a  spatially  smoothed  forward-backward 
covariance  matrix.  This  is  shown  to  be  the  case  in  this 
paper.  It  is  shown  that  proper  choice  of  subarray  length 
can  significantly  improve  the  performance  of  the  method. 
Also  it  is  shown  that  instead  of  using  a  simple  least  squares 
method,  if  an  optimally  weighted  least  squares  procedure 
is  used  in  the  estimation  of  the  state  transition  matrix, 
the  performance  of  the  method  is  enhanced  with  respect 
to  a  DOA,  and  the  sensitivity  to  the  choice  of  the  subar¬ 
ray  length  is  reduced.  A  more  detailed  treatment  of  these 
issues  can  found  in  [5,6,7]. 


"This  work  was  supported  by  the  ARMY  Research  Office  under 
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A1  The  noise  vector  A '(n)  is  assumed  to  be  a  zero  mean, 
complex,  white  circularly  Gaussian  random  vector, 
i.e.  A '(n)  N{n)H  =  crj*  I ,  A '(n)  A’(n)T  =  0  and  is 
independent  of  the  complex  signal  amplitudes  p,(n). 

A2  The  complex  amplitudes  p,{n)  are  modeled  as  zero 
mean  circularly  Gaussian  random  variables. 

A3  The  A'  snapshot  vectors  are  assumed  to  be  indepen¬ 
dent. 

The  covariance  matrix  of  the  amplitudes  is  P  whose  ele¬ 
ments  are  RtJ,  where  P,;  =  [  P.ip)  p)(n)].  Though,  the 
Gaussian  assumption  on  the  signal  amplitudes  (A2)  is  not 
essential  for  the  analysis  [6.3],  it  is  assumed  in  this  paper 
for  simplicity. 

2.2  Different  Covariance  Matrix  Estimators 

Forward  only  (F)  approach  :  In  this  approach,  an 
estimate  of  the  covariance  matrix  is  obtained  by  straight¬ 
forward  (time)  averaging  of  the  outer  product  of  the  A' 

'In  this  paper,  the  overbar  will  be  used  .o  denote  the  expec¬ 
tation  operator.  The  superscript  T  is  used  to  denote  transpose,  •  to 
denote  complex  conjugate,  H  to  denote  complex  conjugate  transpose, 
and  4  to  denote  the  pseudoinverse. 
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Abstract 

In  this  paper,  a  systematic  approach  for  the  analysis  of 
roundoff  noise  in  floating  point  digital  filters  is  presented. 
The  analysis  is  based  on  a  high  level  model  developed  to 
deal  with  the  errors  in  the  inner  product  operation.  The 
model  consists  of  an  efficient  procedure  to  keep  track  of  the 
addition  scheme  used  in  the  inner  product,  and  tocompute 
the  statistics  of  the  errors.  The  tractability  of  the  analysis 
is  demonstrated  by  der:ving  general  expressions  for  the 
roundoff  noise  of  FIR  and  HR  filters.  Also  the  connection 
between  coefficient  sensitivity  analysis  and  roundoff  noise 
analysis  are  discussed.  * 

1  INTRODUCTION 

This  paper  develops  a  systematic  and  tractable  procedure 
for  analyzing  roundoff  noise  in  digital  filters  employing 
floating  point  arithmetic.  The  related  problem  of  using 
fixed  point  arithmetic  and  their  effect  on  digital  filters  has 
been  extensively  studied  and  is  reasonably  well  understood 
[1,2].  The  analysis  of  floating  point  digital  filters  has  also 
been  studied  by  researchers  [3,4,5].  Unfortunately,  the  ex¬ 
pressions  turn  out  to  be  cumbersome  and  not  as  insightful. 
Part  of  the  reason  for  the  difficulty  Lies  in  the  model  for 
finite  precision  floating  point  arithmetic.  Unlike  the  case 
of  fixed  point  arithmetic,  where  the  roundoff  errors  could 
be  modeled  as  a  independent  white  noise  sequences  inde¬ 
pendent  of  the  input  signal,  the  roundoff  errors  in  floating 
point  arithmetic  are  correlated  with  the  input  signal  com¬ 
plicating  the  analysis  [4,3].  Also,  unlike  the  fixed  point 
case,  the  order  of  the  computations  has  an  efTect  on  the 
roundoff  error.  Recently  in  [6],  it  was  shown  that  use  of  the 
Factored  State  Variable  Description  can  greatly  enhance 
the  tractability  of  the  analysis.  Also  in  (7],  a  procedure 
for  analyzing  roundoff  noise  based  on  coefficient  sensitivity 
analysis  is  presented. 

This  paper  examines  the  issue  of  output  roundoff  noise 

'Tins  work  wis  supported  by  the  ARMY  Research  Office  under 
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of  floating  point  digital  filters  with  a  view  towards  gener¬ 
alizing  previous  results  [8,4,3].  The  results  of  this  paper 
are  an  extension  of  our  earlier  work  [9],  and  more  details 
can  be  found  in  [10]. 

2  ERRORS  IN  FLOATING  POINT 
ARITHMETIC 

In  this  paper,  it  will  be  assumed  that  rounding  is  used  in 
all  operations.The  notation  /((.)  will  be  used  to  denote 
the  machine  number  resulting  from  floating  point  opera¬ 
tion.  In  floating  point  operations  there  are  errors  in  both 
additions  and  multiplications  [4,3],  i.e. 

/((*  +  y)*(*  +  »)(l  +  <),  (1) 

and 

fl(zy)=xy(l  +  6),  (2) 

and  -2"’  <  r ,6  <  2~q,  q  being  the  number  of  bits  used 
to  represent  the  mantissa.  The  error  variables  r  and  i 
are  assumed  to  have  zero  mean  and  variance  <7?  (  usually 
cr?  =  Kp-  is  assumed).  The  above  basic/elementary  model 
of  the  errors  has  been  used  by  a  number  of  researchers  to 
study  floating  point  digital  filters. 

Note  that  the  errors,  depend  on  the  variables  involved 
in  the  operation.  In  the  context  of  floating  point  digital 
filters,  this  amounts  to  dependence  of  the  output  roundoff 
error  on  the  input  signal  and  the  intermediate  variables 
generated  in  the  filter  making  the  analysis  cumbersome 
and  less  tractable.  This  is  particularly  true  when  the  num¬ 
ber  of  operations  is  large.  Here  we  seek  some  tools  for  the 
purpose  of  enhancing  the  tractability  of  the  analysis  and 
thereby  hopefully  lead  to  new  insight  and  results. 

3  DIGITAL  FILTERS  AND  FLOAT¬ 
ING  POINT  INNER  PRODUCTS 

3.1  Inner  Products  and  Digital  Filters 

In  filter  implementation,  instead  of  starting  with  the  basic 
error  model  it  is  useful  to  recognize  that  inner  products 
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Analysis  of  subspace-based  direction  of  arrival  estimation 
methods 
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Abstract.  In  this  paper,  a  general  framework  for  the  analysis  of  eigen- 
based  subspace  methods  is  developed.  It  is  shown  that  a  two-step  procedure 
can  be  effectively  used  to  analyse  subspace  methods  under  fairly  general 
conditions.  The  first  step  relates  the  errors  in  the  covariance  matrix  to 
errors  in  the  subspaces,  and  the  second  step  relates  error  in  the  subspaces 
to  the  errors  in  the  direction  of  arrival  (doa)  estimates.  Combining  these 
two  steps  along  with  the  statistics  of  the  data,  expressions  for  the  mean 
squared  error  in  the  doa  estimate  are  derived.  The  potential  of  the  approach 
is  demonstrated  by  analysing  two  subspace  methods,  music  and  the 
minimum-norm  method. 

Keywords.  Array  processing;  direction  of  arrival  estimation;  subspace 
methods;  statistical  analysis. 


1.  Introduction 

Eigen-decomposition  based  methods  have  recently  received  a  great  deal  of  attention 
(Bienvenu  &  Kopp  1979;  Schmidt  1979;  Kumaresan  &  Tufts  1983;  Cadzow  1988; 
Rao  1988;  Ottersten  1989;  Roy  &  Kailath  1989;  Viberg  1989).  These  methods,  referred 
to  as  subspace  methods,  decompose  the  space  spanned  by  the  eigenvectors  of  the 
observed  covariance  matrix  into  two  orthogonal  subspaces  referred  to  as  the  signal 
and  noise  subspace.  In  the  recent  past,  an  extensive  analysis  of  these  methods  has 
been  conducted  by  a  number  of  researchers  providing  valuable  insight.  The  first  work 
in  this  context  has  been  presented  in  Jeffries  &  Farrier  (1985)  and  Kaveh  &  Barabell 
(1986),  where  the  resolution  capability  of  music  and  the  Minimum-Norm  method 
were  studied  by  examining  the  null  spectrum.  Recently,  expressions  for  the  asymptotic 
mean  squared  error  in  the  direction  of  arrival  (doa)  estimate  have  been  developed 
(Porat  &  Friedlander  1988;  Rao  &  Hari  1989a,  b;  Stoica  &  Nehorai  1989,  1991). 
The  results  have  also  been  extended  to  deal  with  the  effect  of  spatial  smoothing 
(Ciergeot  et  al  1989;  Pillai  &  Kwon  1989;  Rao  &  Hari  1990)  and  sensor  errors 
(Friedlander  1989;  Swindiehurst  et  al  1989).  Using  the  insight  gained  from  these 
results,  a  general  frame v-  ,-k  for  analysing  subspace  methods  is  developed.  The  overall 
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Abstract 

Various  methods  for  mapping  algorithms  into  sys¬ 
tolic  arrays  have  been  developed  in  the  past  few  years. 
In  this  paper,  efficient  scheduling  techniques  are  devel¬ 
oped  for  methods  in  partitioning  problems  that  do  not 
match  the  array  sire  exactly.  In  particular ,  schedul¬ 
ing  for  the  Locally  Parallel- Glob  ally  Sequential  (LPGS) 
technique  and  the  Locally  Sequenttal-Globally  Parallel 
(LSGP)  technique  are  developed.  The  scheduling  pro¬ 
cedure  developed  exploits  the  fact  that  after  LPGS  and 
LSGP  partitioning,  the  locality  constraints  get  modified 
allowing  one  to  use  certain  inter-connections  that  were 
not  available  before.  The  scheduling  method  allows  vs  to 
develop  a  flexible  scheduling  order  for  LPGS  that  is  use¬ 
ful  in  evaluating  a  trade-off  between  execution  time  and 
size  of  partitioning  buffers.  The  scheduling  techniques 
are  illustrated  with  the  help  of  matrix  multiplication  and 
QR  decomposition  examples. 


array  form.  Very  often  the  array  that  is  obtained  by 
these  mapping  procedures  is  suited  only  for  a  particular 
size  of  the  problem.  An  array  designed  for  that  size  only 
could  be  very  inefficient  or  even  unusable  if  the  target 
problem  size  were  bigger.  It  is  critical  that  the  design 
system  should  incorporate  a  lecltuiu'ie  for  partitioning  a 
larger  problem  as  well  as  provide  ext  i  a  hardware  devices 
that  can  handle  this  partitioning. 

In  section  2,  we  review  the  main  issues  involved 
in  partitioning  systolic  algorithms,  along  with  a  brief 
description  of  the  two  main  cab  juries  of  partitioning 
methods.  In  section  3,  we  discus-  ;t  scheduling  method 
based  on  modification  of  the  locality  constraints  of  par¬ 
titioned  Dependence  Graphs,  as  well  as  a  scheduling 
order  for  LPGS  scheme  when  there  is  a  constraint  on 
the  size  of  the  buffers  that  arc  needed  for  partitioning 
The  benefits  of  the  proposed  procedures  are  illustrated 
with  the  help  of  matrix  multiplication  and  QR  decom¬ 
position  algorithms  in  Section  4. 


1  Introduction 

Recent  advances  in  VLSI  technology  and  design  has 
made  possible  the  realization  of  low  cost  Application 
Specific  Array  Processors  (ASAPs)  for  computationally 
intensive  image  and  signal  processing  algorithms.  A 
well  known  approach  to  VLSI  implementation  of  a  sig¬ 
nal  processing  algorithm  is  to  design  a  systolic  array  for 
that  algorithm.  A  systolic  array  is  an  ASAP  made  up 
of  regularly-connected  processing  elements,  all  of  which 
are  connected  locally  and  exploit  the  inherently  regu¬ 
lar  nature  of  signal  processing  algorithms  in  order  to 
achieve  the  high  throughput  demands  of  the  tasks. 

Considerable  effort  has  been  expended  by  researchers 
to  find  procedures  to  map  algorithms  onto  a  systolic 
array  [1,2,3].  These  methods  aim  to  systematically  map 
a  given  algorithm  into  a  high-level  hardware  processor 

*Thj»  -work  *as  »upported  in  pan  by  the  UCSD/NSF  Inte¬ 
grated  Circuit*  And  Systems  Research  Center  and  by  the  ARMY 
Research  Office  under  Grant  No.  DA  AL-03-90-G-009S. 


2  Mapping  &:  Partitioning  issues 

General  partitioning  methods  are  often  derived  from 
the  mapping  procedures  for  full-size  arrays.  Most  map¬ 
ping  procedures  are  only  applicable  to  a  class  of  algo¬ 
rithms  that  can  be  represented  by  nested  loops  with 
uniform  dependencies.  The  algorithms  are  written  in 
the  form  of  for-loops  and  in  Single- Assignment  form; 
i.e.  each  variable  is  assigned  a  value  only  one  time  dur¬ 
ing  the  algorithm,  no  variable  is  overwritten.  The  al¬ 
gorithm  is  then  represented  by  an  indexed  dependence 
graph  (DG)  in  an  Index  space.  The  DG  contains  nodes 
at  various  points  in  the  Index  space  representing  all  the 
computations  that  are  indexed  by  that  index  point.  The 
edges  represent  the  data  dependencies  between  compu¬ 
tations  at  various  index  points.  This  DG  form  is  use¬ 
ful  in  removing  unwanted  data  broadcasts  by  allowing 
dependencies  between  adjacent  nodes  only.  This  spa¬ 
tial  locality  preserves  the  local  nature  of  inter-processor 
connections  characteristic  of  a  systolic  array. 
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Abstract 

In  this  paper,  the  performance  of  spatially  smoothed 
■weighted  MUSIC,  and  weighted  stute  space  uieth- 
ods/ESPRIT  are  analyzed,  and  compared  for  the  di¬ 
rection  of  arrival  (DOA)  estimation  problem.  In  par¬ 
ticular,  a  hey  outcome  of  the  analysis  is  the  observa¬ 
tion  that  when  a  forward-backward  spatially  smoothed 
approach  is  used,  optimally  weighted  MUSIC  and  opti¬ 
mally  weighted  state  space  meihods/ESPRl'T  have  iden¬ 
tical  asymptotic  behavior.  Also  it  is  shown  that  the 
forward-backward  covariance  matrix  is  belter  condi¬ 
tioned  than  the  forward  only  covariance  matrix  provid¬ 
ing  additional  justification  for  the  use  of  the  forward- 
backward  approach.  The  analysis  is  shown  to  be  extend¬ 
able  to  the  time  series  frequency  estimation  problem, 
thereby  providing  a  unified  framework  for  dealing  with 
DOA  estimation  and  time  series  frequency  estimation. 


1  INTRODUCTION 

In  this  paper,  the  efTcct  of  using  a  Forward-Backward 
spatially  Smoothed  (FBS)  covariance  matrix  on  the  sta¬ 
tistical  performance  of  weighted  eigen- based  state  space 
based  methods  or  ESPRIT  and  weighted  MUSIC  is  an¬ 
alyzed.  In  recent  years,  a  statistical  evaluation  of  sub- 
space  based  methods  has  be-  n  conducted  by  a  num¬ 
ber  of  researchers  with  particular  attention  being  paid 
to  the  case  where  the  estimate  of  Lite  covariance  ma¬ 
trix  was  obtained  by  a  straight  forward  averaging  of 
the  outer  product  of  the  snapshots.  It  was  shown  that 
MUSIC  performs  belter  than  eigen-based  stale  space 
methods  with  the  difference  becoming  significant  as  the 
length  of  the  array  increases.  However,  state  space 
methods  are  computationally  more  attractive  and  there 
is  incentive  to  seek  ways  to  improve  the  statistical  prop¬ 
erties.  It  is  shown  that,  this  deficiency  can  he  over¬ 
come  by  using  a  spatially  smoothed  forward-hack  ward 

/Ills  work  wii  'pporURl  by  l he  ARMY  Research  Oilicc  mi* 
<hv  uruiil  No.  DA  A-OVOO-G-UUdG 


covariance  matrix  and  proper  weighting.  A  key  result  of 
the  analysis  is  that  optimally  weighted  MUSIC  and  op¬ 
timally  weighted  State  Space  Methods/ESPRIT  have 
identical  asymptote  performance.  Amongst  the  co- 
variance  estimators,  it  is  shown  that  combining  spatial 
smoothing  with  the  forward-backward  approach  is  more 
effective  than  using  forward  spatial  smoothing  alone 
Another  important  attribute  of  the  FBS  approach  for 
the  problem  of  narrowband  DOA  estimation  using  an 
ULA  is  that  it  is  naturally  related  to  the  time  series 
frequency  estimation  problem,  i.c.  sinusoids  in  noise 
problem.  This  paper  capitalizes  on  this  relationship 
and  the  analysis  framework  [1 ,2]  to  establish  an  unified 
framework  for  these  problems. 


2  PROBLEM  FORMULATION 


The  output  vector  of  a  UlA  of  L\  sensors  is  given 
by 
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where  u>,  =  — ^ ...  sin  0,,  d  being  the  separation  between 
sensors,  \  the  wavelength  of  the  incident  signal,  and  0, 
the  DOA.  Due  to  the  simple  mapping  between  w,  and 
0i,  for  simplicity,  w,  will  also  be  often  referred  to  as  the 
DOA. 


2.1  FBS  Covariance  Matrix  Estimate 


Exploiting  ( he  structure  in  the  ULA,  the  general  FBS 
estimate  is  given  by 
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Floating  Point  Arithmetic  and  Digital  Filters 

Bhaskar  D.  Rao,  Member,  IEEE 


Abstract — lit  this  paper,  flic  ruundoff  noise  properties:  of 
floating  point  digital  tillers  arc  examined.  To  make  llic  analysis 
tractable,  a  high  level  model  to  deal  with  the  errors  in  the  inner 
product  operation  is  developed.  This  model  establishes  a  broad 
connection  between  coellicien!  Sensitivity  and  roundull'  noise. 
Along  with  the  model,  an  ellicienl  procedure  to  keep  track  of 
the  addition  scheme  used  in  the  inner  product,  and  to  compute 
the  statistics  of  the  errors  is  introduced.  A  systematic  proce¬ 
dure  based  on  the  model  is  then  de>  eloped  to  derive  general 
expressions  for  the  roundoff  noise  of  FIR,  direct  furm  HR,  and 
state-space  Alters.  The  expressions  in  the  context  of  slate  space 
fillers  are  explored  in  some  detail.  Optimality  issues  are  con¬ 
sidered,  and  it  is  shown  that  when  double  precision  accumula¬ 
tion  is  used,  the  optimal  filters  arc  similar  in  nature  to  those 
derived  in  the  context  of  fixed  point  arithmetic  with  the  essen¬ 
tial  difference  that  they  also  do  depend  on  the  spectrum  of  the 
input  signal.  Optimality  with  respect  to  addition  schemes,  and 
second-order  litters  are  also  examined  in  some  detail. 


1.  Introduction 

LOAT1NG  point  arithmetic  is  widely  used  in  signal 
processing  computations.  More  recently,  with  the  in¬ 
creasing  availability  of  floating  point  capability  in  signal 
processing  chips,  insights  into  algorithms  employing 
floating  point  arithmetic  is  of  increasing  interest.  This  pa¬ 
per  considers  the  problem  of  digital  filter  implementation, 
and  examines  the  effect  of  floating  point  arithmetic  on 
them.  The  related  problem  of  using  fixed  point  arithmetic 
and  their  effect  on  digital  fillers  has  been  extensively  stud¬ 
ied  and  is  reasonably  well  understood  1 1 1  - ( 5 ] .  The  anal¬ 
ysis  of  floating  point  digital  filters  has  also  been  studied 
by  researchers  [6]-[14],  Unfortunately,  the  expressions 
turn  out  to  be  cumbersome  and  noi  as  insightful.  Pan  of 
the  reason  for  the  difficulty  lies  in  the  model  for  finite 
precision  floating  point  arithmetic.  Unlike  the  case  of 
fixed  point  arilhmelic,  where  ihe  roundoff'  errors  could  be 
modeled  as  independent  white  noise  sequences  indepen¬ 
dent  of  ihe  input  signal,  (he  roundoff  errors  in  flouting 
point  arilhmelic  are  correlated  with  the  inpul  signal  com¬ 
plicating  Ihe  analysis  |7],  [6|.  Also,  unlike  the  fixed  point 
case,  the  order  of  the  computations  has  an  effect  on  the 
roundoff  error.  Recently,  in  f  15],  it  was  shown  that  use 
of  the  factored  state  variable  description  can  greatly  en¬ 
hance  the  traclability  of  the  analysis.  It  was  used  to  derive 
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expressions  for  the  roundoff  noise  of  arbitrary  filter  struc¬ 
tures,  and  to  provide  a  quantitative  comparison  of  fixed 
and  floating  point  implementations.  More  recently,  it  has 
been  shown  that  the  traclability  of  the  analysis  can  be  en¬ 
hanced  by  connecting  roundoff  analysis  to  coefficient  sen¬ 
sitivity  analysis  126),  [27],  |17j.  This  paper  reexamines 
the  issue  of  output  roundoff  noise  of  floating  point  digital 
filters  with  a  view  towards  generalizing  the  exist ing  re¬ 
sults,  and  providing  a  more  tractable  and  hopefully  in¬ 
sightful  approach  for  dealing  with  floating  point  errors. 

The  outline  of  this  paper  is  as  follows.  To  enhance  the 
traclability  of  the  analysis,  in  Section  11,  a  high  level 
model  for  the  inner  product,  an  operation  basic  to  digital 
filters,  is  developed.  The  model  indicates  a  broad  rela¬ 
tionship  between  roundoff  noise  and  coefficient  sensitiv¬ 
ity.  Along  with  the  model,  an  efficient  procedure  to  keep 
track  of  the  addition  scheme  used  in  the  inner  product, 
and  to  compute  the  statistics  of  the  error  is  introduced.  A 
systematic  approach  based  on  this  model  is  then  devel¬ 
oped  to  derive  expressions  for  the  output  roundoff  noise 
of  different  filter  structures  (Section  IV).  The  FIR  and  HR 
filter  structures  are  examined  in  Section  III.  The  results 
serve  to  illustrate  the  generality  and  simplicity  of  the  ap¬ 
proach.  The  potential  of  this  approach  is  further  demon¬ 
strated  by  analyzing  the  more  complicated  state-space 
digital  tillers  in  Section  V.  An  exact  expression  for  the 
variance  of  the  output  roundoff  noise  is  derived  when  the 
input  to  the  filter  is  a  zero-mean  wide-sense  stationary 
random  process.  It  explicitly  indicates  the  effect  of  the 
filler  parameters,  the  statistics  of  the  input  signal,  and  the 
addition  scheme  used  in  the  computation  on  the  roundoff 
noise.  Various  properties  and  optimality  issues  relating  to 
state  space  filters  are  considered  in  Section  VI.  For  in¬ 
stance,  when  double  precision  accumulation  is  used,  it  is 
shown  that  the  optimal  filter  structures  are  similar  to  those 
obtained  when  using  fixed  point  arithmetic.  Issues  related 
to  addition  schemes,  and  second-order  structures  are  also 
examined.  Some  of  these  results  were  first  presented  in 
1161,117]. 

11.  Inner  Products  and  Floating  Point  Arithmetic 
A.  Basic  Error  Model 

First  we  discuss  the  errors  that  arise  when  floating  point 
arithmetic  is  used,  and  develop  a  model  to  cope  with  these 
errors  in  the  context  of  digital  filters.  Throughout  this  pa¬ 
per  ii  will  be  assumed  that  floating  point  numbers  are 
stored  in  the  form  (sign)  ■  n  •  2”,  where  n  and  v  have  a 
fixed  number  of  bits.  Also  it  will  be  assumed  that  round- 
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This  paper  is  a  tutorial  on  linear,  state  space,  model-based 
methods  for  certain  nonlinear  estimation  problems  commonly  en¬ 
countered  in  signal  and  data  analysis.  A  prototypical  problem 
that  is  studied  is  that  of  estimating  the  frequencies  of  rhiple , 
superimposed  sinusoids  from  a  short  record  of  noise-corrupted 
data.  The  approach  expounded  however,  is  applicable  to  a  vast 
range  of  nonlinear  signal  analysis  problems,  and  applications  in 
direction  finding  and  damped  sinusoid  retrieval  are  dealt  with 
in  some  detail  The  benefits  that  result  from  using  a  state  space 
description  of  the  signal  are  highlighted  in  this  paper.  It  is  shown 
that  state  space  models  provide  an  elegant  tool  for  exposing  the 
structure  present  in  the  problem.  The  approach  also  allows  for 
robust  parameterization  of  the  model  with  respect  to  finite  precision 
errors.  The  robustness  of  the  parameter  set  is  complemented  by  the 
availability  of  numerically  robust  tools  to  estimate  the  parame¬ 
ters.  The  resulting  algorithms  are  compatible  with  multiprocessor 
implementations. 

I.  Introduction 

The  problem  of  estimating  closely  spaced  frequencies  of 
multiple,  superimposed  sinusoids  from  noisy  measurements 
of  the  time-series  or  its  covariance  lags,  is  prototypical  of 
a  class  of  nonlinear  parameter  estimation  problems  that 
has  a  vast  range  of  signal  processing  applications.  Some 
other  problems  that  belong  in  this  class  are  the  problem  of 
estimating  the  damping  factors  and  frequencies  of  damped 
sinusoids  and  exponentials  from  a  linear  comoination  of  the 
same,  the  identification  of  a  linear,  time-invariant,  rational 
system  from  impulse  response  or  input-output  data,  model- 
based  power  spectrum  estimation  for  a  stochastic  process, 
the  problem  of  separating  a  small  number  of  overlapping 
echoes  of  an  unknown  signal,  time  delay  estimation,  and  the 
problem  of  narrow-band  source  bearing  estimation  using 
a  multisensor  array.  These  and  closely  related  problems 
appear  in  many  different  fields  within  electrical  engineer¬ 
ing,  and  have  been  addressed  by  researchers  in  diverse 
disciplines,  such  as  sonar,  radio  astronomy,  interference 

Manuscript  received  October  16,  1989;  revised  February  8,  1991.  This 
work  was  supported  by  SDiO/IST  under  Contracts  DAAL-03-90-G-0095 
and  DAAL-03-91-G-0118  managed  by  the  U  S.  Army  Research  Office. 

B.  D.  Rao  is  with  the  Department  of  Electrical  and  Computer  Engineer¬ 
ing,  University  of  California,  La  Jolla,  CA  92093-0407. 

K.  S.  Anm  is  with  the  Coordinated  Science  Laboratory,  University  of 
Illinois,  Urbana,  IL  61801 

IEEE  Log  Number  9106244. 


spectroscopy,  seismic  data  processing,  and  NMR  spectro¬ 
scopic  imaging. 

In  recent  years  there  has  been  a  great  deal  of  attention 
paid  to  model-based  eigendecomposition  methods  for  these 
problems.  The  use  of  linear  models  for  the  signal  to  be 
processed,  can  convert  a  nonlinear  estimation  problem 
into  the  simpler  problem  of  estimating  the  parameters 
of  the  linear  model  [1],  The  nonlinearity  is  postponed 
to  the  second  step,  which  in  all  model-based  methods 
is  the  step  where  the  desired  information  (frequencies, 
damping  factors,  directions  of  arrival)  is  extracted  from 
the  estimated  model  parameters.  Both  steps  are  crucial 
to  the  overall  success  of  a  model-based  method,  and  ill- 
conditioning  at  either  step  can  adversely  effect  the  method's 
performance.  The  reliability  of  the  first  step  depends  on  the 
model-parameter  estimation  scheme,  and  that  of  the  second 
step  on  the  sensitivity  of  the  desired  information  to  the 
model  parameters.  Often  in  signal  processing,  a  polynomial 
realization  of  the  linear  modef  has  been  assumed  and  used. 
A  state  space  representation  of  the  linear  model  is  a  viable 
alternative,  and  is  sometimes  desirable  for  these  problems. 
State  space  representation  provides  flexibility  in  the  model 
parameterization,  and  can  make  both  steps  of  the  model 
based  procedure  reliable. 

This  paper  reviews  the  state  of  the  art  in  state  space  model 
based  signal  processing,  and  discusses  the  advantages  of 
adopting  a  state  space  approach.  While  the  presentation 
deals  mainly  with  the  representative  problem  of  sinusoid 
retrieval,  the  issues  and  approach  are  applicable  to  other 
related  problems  including  the  ones  listed  above.  In  each  of 
these  problems,  an  invariance  structure  inherent  to  the  data 
is  made  explicit  by  the  state  space  approach,  which  can  be 
used  to  extract  the  desired  information  regarding  the  signal. 
In  addition,  the  state  space  approach  is  shown  to  provide 
a  degree  of  flexibility  in  model  parameterization,  which 
if  properly  exploited  can  greatly  enhance  performance.  In 
contrast  to  the  more  classical  polynomial  or  transfer  func¬ 
tion  parameterization  which  requires  polynomial  rooting  to 
get  to  the  final  quantities  of  interest,  state  space  parame¬ 
terization  allows  the  use  of  numerically  robust  techniques 
such  as  eigendecomposition  of  well-conditioned  matrices 
to  extract  the  desired  quantities.  Also,  it  will  be  seen  that 
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Various  methods  for  mapping  signal  processing  algorithms  into  systolic  arrays  have  been  devel¬ 
oped  in  the  past  few  years.  In  this  paper,  efficient  scheduling  techniques  are  developed  for  the  parti¬ 
tioning  problem,  i.e.  problems  with  sice  that  do  net  match  the  array  sice.  In  particular,  scheduling 
for  the  Locally  Parallel- Globally  Sequential  (LPGS)  technique  and  the  Locally  Sequential-Globally 
Parallel  (LSGPJ  technique  are  developed.  The  scheduling  procedure  developed  ezplcits  the  fact  that 
after  LPGS  and  LSGP  partitioning,  the  locality  constraints  get  modified  allowing  for  more  flexi¬ 
bility  and  the  use  of  inter-processor  connections  that  were  not  available  before.  The  new  structure 
allows  us  to  develop  a  flexible  scheduling  order  for  LPGS  the!  is  usefu  n  evaluating  a  trade-off 
between  execution  time  and  sice  of  partitioning  buffers.  The  benefits  0j  the  scheduling  techniques 
are  illustrated  with  the  kelp  of  mairiz  multiplication  and  Least  Squares  examples. 

1  Introduction 

Recent  advances  in  VLSI  technology  and  design  has  made  possible  the  realization  of  low  cost 
Application  Specific  Array  Processors  (ASAPs)  for  computationally  intensive  image  and  signal 
processing  algorithms.  In  real-time  signal  processing  applications,  ASAPs  offer  an  attractive  al¬ 
ternative  to  general  purpose  computing  machines.  A  well  known  approach  to  implementation  of 
an  algorithm  is  to  design  a  systolic  array  for  that  algorithm.  A  systolic  array  is  an  ASAP  made 
up  of  regularly-connected  processing  elements,  all  of  which  are  connected  locally  and  exploit  the 
inherently  regular  nature  of  signal  processing  algorithms  in  order  to  achieve  the  high  throughput 
demands  of  the  tasks. 

Considerable  effort  has  been  expended  by  researchers  in  the  past  few  years  to  find  systematic 
procedures  to  map  algorithms  onto  a  systolic  array  (1,2,3).  Although  these  tools  provide  a  frame¬ 
work  for  synthesis  and  analysis  of  systolic  arrays,  there  are  some  limitations  when  using  them  in 
practical  design  scenarios.  Most  DSP  algorithms  involve  large  data  vectors  or  matrices  for  which 
the  systolic  array  would  require  a  large  number  of  Processing  Elements  (PEs).  Using  a  large  num¬ 
ber  of  PEs  poses  system  level  and  VLSI  problems.  Current  VLSI  technology  still  does  not  allow  for 
implementing  a  really  large  number  of  PEs  on  a  single  chip,  no  matter  how  simple  the  processor 
structure.  Using  a  number  of  processor-chips  leads  to  problems  with  data  I/O.  Integrated  Circuits 
have  a  limited  number  of  pins  and  therefore  crossing  chip  boundaries  becomes  a  bottleneck  [4], 

‘This  work  was  supported  in  part  by  the  UCSD/NSF  Integrated  Circuits  And  Systems  Research  Center 
and  by  the  ARMY  Research  Office  under  Grant  No.  D  AAL-03-90-G-0095. 
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ABSTRACT 


Orthogonal  matrix  transformations  form  an  important  part  of  matrix-based  signal  processing  applications.  Systolic 
arrays  for  computing  these  algorithms  have  been  developed  and  the  size  of  these  arrays  usually  depends  directly  on  the 
size  of  the  problem.  For  large  matrix  sizes,  implementing  large  numbers  of  processors  in  hardware  is  not  physically 
feasible.  In  this  paper,  we  examine  two  popular  orthogonal  transformations,  Givens  Rotations  and  Householder 
Transformations  (TIT),  from  the  viewpoint  of  realizing  a  fixed-size  parallel  processor  array  that  can  handle  large  data 
matrices.  An  efficient  scheduling  procedure  is  used  to  compute  the  HT  on  a  systolic  type  array,  its  performance  is 
compared  with  that  of  an  array  designed  for  computing  the  Givens  method.  An  important  conclusion  resulting  from 
the  comparison  is  that  the  performance  of  the  HT  array  is  superior  to  that  for  the  Givens  method  when  the  matrices 
are  larger  compared  to  the  array  size. 


1.  INTRODUCTION 


There  are  several  applications  in  signal  processing  where  orthogonal  triangularization  procedures  are  very  helpful. 
For  example,  methods  like  Givens  Rotations  and  Householder  Transformations  (HT)1  are  used  for  computing  QR 
Decomposition  (QRD),  Least-Squares  filtering,  eigendecomposition,  SYD,  etc. 

The  method  of  Givens  Rotations  has  been  &  popular  choice  in  computing  the  QRD.  This  is  a  computationally 
simple  method  that  has  been  found  to  be  amenable  to  implementation  on  special-purpose  parallel  computing  machines 
like  multiprocessor  arrays  and  systolic  structures.  Several  systolic  arrays  can  be  found  in  literature2  which  use  Givens 
Rotations  in  order  to  compute  matrix  operations  like  QRD,  etc.  The  computations  required  by  the  Givens  method 
are  spatially  local  by  nature  and  therefore  an  attractive  choice  for  implementation  on  a  systolic  array. 

Unlike  the  Givens  method  which  annihilates  one  element  of  a  matrix/vector  at  a  time,  the  IIT  approach  is  a 
flexible  way  by  which  several  elements  of  a  matrix  or  a  vector  can  be  annihilated  at  one  time.  From  the  standpoint  of 
numerical  performance  (finite  precision  efTects),  the  HT  is  a  superior  method  when  compared  to  the  Givens  method3. 
Another  reason  that  makes  the  IIT  the  more  attractive  method  to  use  is  its  computational  complexity.  For  example, 
the  numbers  of  flops  required  to  compute  the  QRD  of  a  p  x  n  matrix  using  Givens  Method  is  2n2(p  —  nj 3)  while 


Sixth  SP  Workshop  on  Statistical  Signal  and  Array  Processing,  Oct.  92 


A  New  Iterative  Weighted  Norm  Minimization  Algorithm  and  its 

Applications* 

Irina  F.  Gorodnitsky  and  Bhaskar  D.  Ra-o 
Electrical  and  Computer  Engineering  Department 
University  of  California,  San  Diego 
La  Jolla,  CA  92093-0407 


Abstract 

A  general  class  of  linear  inverse  problems  in  which 
the  solutions  are  sparse  and  localized  are  considered 
in  this  paper.  We  propose  an  iterative  weighted  mini¬ 
mum  norm  algorithm  for  finding  such  constrained  solu¬ 
tions.  A  unique  feature  of  this  algorithm  is  that  it  is  a 
nonparametric  approach  that  finds  sparse  and  localized 
solutions  without  prior  information  on  the  constraints. 
Each  step  of  the  iterative  procedure  consists  of  solving  a 
weighted  least  squares  problem  wherein  the  weighting 
matrix  is  determined  by  the  solution  from  the  previ¬ 
ous  iteration.  Some  properties  of  the  algorithm  along 
with  its  applications  to  problems  in  direction  of  arrival 
(DOA)  ind  spectrum  estimation  are  presented. 

1  Introduction 

An  important  problem  in  signal  processing  is  signal 
characterization  and  reconstruction  from  a  limited  lin¬ 
early  mapped  set  of  measurements.  The  general  prob¬ 
lem  is  underdetermined  and  characterized  by  having  an 
infinite  set  of  possible  solutions.  The  nonuniqueness 
is  resolved  by  further  constraining  the  problem  with 
prior  information  [1],  Here  we  discuss  a  nonparametric 
approach  which  has  potential  applications  in  spectral 
estimation,  direction-of  arrival  (DOA)  estimation,  and 
other  signal  analysis  problems  where  the  solution  is  as¬ 
sumed  to  be  sparse  and  localized.  No  prior  information 
on  the  number  and  nature  of  the  localizations  in  the 
solution  space  is  assumed.  For  example,  in  the  narrow- 
band  DOA  estimation  application,  given  sensor  mea¬ 
surements  the  objective  is  to  reconstruct  a  spatial  spec- 

•Thi*  research  ha*  been  supported  in  part  by  the  ARMY  Re¬ 
search  Office  under  Grant  No.  DAAL-03-90-G-0095.  I.  Gorod¬ 
nitsky  was  also  supported  in  part  by  Los  Alamos  National 
Laboratory 


trum  that  has  energy  localized  in  certain  spatial  regions 
[2].  The  advantage  of  the  nonparametric  approach  in 
this  context  is  that  it  can  handle  sources  with  small  fi¬ 
nite  extent  in  addition  to  point  sources.  The  algorithm 
was  first  developed  for  the  biomagnetic  neuroimaging 
inverse  problem  [3,4].  This  paper  further  explores  the 
algorithm  and  its  potential  applications  in  signal  pro¬ 
cessing. 

2  Background 

The  general  discrete  underdetermined  linear  inverse 
problem  consists  of  finding  a  solution  to  the  system 

Ax=b,  (1) 

where  A  is  m  x  n,  m  <  n,  and  has  rank  m.  The  number 
of  solutions  is  infinite  and  the  solution  vectors  are  given 
by  x  =  zmn  +  v,  where  v  is  a  vector  in  the  null  space  of 
A  and 

=  A+h,  (2) 

A+  denotes  the  Moore-Penrose  inverse  [5].  The  vector 
*mn  >  called  the  minimum  norm  or  the  minimum  energy 
solution  lies  entirely  in  the  range  space  of  AH  and  has 
the  unique  property  of  being  the  vector  of  smallest  2- 
norm  satisfying  (1). 

In  this  paper,  solutions  to  (1)  that  are  sparse,  local¬ 
ized,  and  contiguous  are  sought.  The  need  for  a  sparse 
x  can  be  motivated  by  considering  the  problem  of  si¬ 
nusoid  frequency  estimation.  The  measurement  vector 
b  consists  of  m  samples  of  data  which  are  a  sum  of 
p  complex  exponentials  (p  <  m).  The  columns  of  A 
are  of  the  form  [l,e-J", The  n 
columns  of  A  are  formed  by  choosing  w  from  the  range 
(— *■,*■).  The  choice  of  the  values  of  u  is  rather  arbi¬ 
trary  and  may  reflect  prior  knowledge.  If  m  =  n,  and  u 
is  is  chosen  by  uniformly  sampling  the  frequency  axis, 
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Abstract— In  this  paper,  the  effect  of  using  a  spatially 
smoothed  forward-backward  covariance  matrix  on  the  per¬ 
formance  of  weighted  eigen-based  state  space  methods/ES 
PRIT,  and  weighted  MUSIC  for  the  direction-of-arrival  (DOA) 
estimation  is  analyzed.  Expressions  for  the  mean-squared  error 
in  the  estimates  of  the  signal  zeros  and  the  DOA  estimates,  along 
with  some  general  properties  of  the  estimates  and  optimal 
weighting  matrices  are  derived.  A  key  result  of  the  analysis  is 
that  optimally  weighted  MUSIC  and  weighted  state  space  meth- 
ods/ESPRlT  have  identical  asymptotic  performance.  It  is  also 
shown  that  by  properly  choosing  the  number  of  subarrays,  the 
performance  of  unweighted  state  space  methods  can  be  signif¬ 
icantly  improved.  Then  it  is  shown  that  the  mean-squared  error 
in  the  DOA  estimates  obtained  using  subspace  based  methods 
is  independent  of  the  exact  distribution  of  the  source  ampli¬ 
tudes.  This  results  in  an  unified  framework  for  dealing  with 
DOA  estimation  using  a  uniformly  spaced  linear  sensor  array 
(ULA),  and  the  time  series  frequency  estimation  problem.  The 
resulting  analysis  of  the  time  series  case  is  shown  to  be  more 
accurate  than  previous  results. 

I.  Introduction 

IN  this  paper,  weighted  subspace  based  methods  for  es¬ 
timating  the  direction  of  arrival  (DOA)  of  plane  waves 
in  noise  using  a  uniformly  spaced  linear  array  (ULA)  are 
considered.  In  particular,  the  effect  of  using  a  spatially 
smoothed  forward-backward  covariance  matrix  on  the 
statistical  performance  of  weighted  eigen-based  state 
space  based  methods  [1]  or  ESPRIT  [2]  and  weighted 
MUSIC  is  analyzed.  An  examination  of  unweighted  MU¬ 
SIC  method  under  these  conditions  has  recently  been 
studied  in  [3]-[6],  and  hence  in. this  paper  there  is  greater 
emphasis  on  the  weighted  state  space  methods/ESPRIT. 
ESPRIT  was  developed  for  general  arrays  which  possess 
a  displacement  invariance  [2]  and  reduces  to  a  state  space 
method  for  the  ULA  case  [1],  [7],  [8].  However,  the  state 
space  methods  were  developed  firs*  and  deal  extensively 
with  the  ULA  case,  the  problem  of  interest  here  [1],  [8]- 
[10].  In  particular,  the  use  of  spatial  smoothing  and  the 
forward-backward  approach  in  the  manner  developed  here 
were  first  discussed  in  the  context  of  state  space  methods. 

Manuscript  received  August  24,  1990;  revised  December  31,  1991.  This 
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Hence,  the  use  of  the  term  state  space  methods  appears 
more  appropriate  and  will  be  used  in  this  paper. 

In  recent  years,  a  statistical  evaluation  of  subspace 
based  methods  has  been  conducted  by  a  number  of  re¬ 
searchers  [3],  [4],  [8],  [  1 1]-[  19} .  Particular  attention  has 
been  paid  to  the  case  where  the  estimate  of  the  covariance 
matrix  was  obtained  by  a  straight  forward  averaging  of 
the  outer  product  of  the  snapshots.  In  [15],  [17],  [8],  [6], 
it  was  shown  that  MUSIC  performs  beuer  than  eigen- 
based  state  space  methods  with  the  difference  becoming 
significant  as  the  length  of  the  array  increases.  However, 
state  space  methods  are  computationally  more  attractive 
and  there  is  incentive  to  seek  ways  to  improve  the  statis¬ 
tical  properties.  Weighted  eigen-based  state  space  meth¬ 
ods  and  weighted  MUSIC  are  analyzed,  and  it  is  shown 
that  this  deficiency  can  be  overcome  by  using  a  spatially 
smootheJ  forward-backward  covariance  matrix  and 
proper  weighting.  These  results  are  consistent  with  the 
past  successful  uses  of  the  forward-backward  approach, 
first  for  autoregressive  parameter  estimation  [20],  and 
later  for  the  problem  of  sinusoid  frequency  estimation 

[21] ,  [9],  and  for  DOA  estimation  of  coherent  sources 

[22] — [24] . 

Another  important  attribute  of  the  forward-backward 
smoothing  approach  is  that  it  enables  a  natural  link  be¬ 
tween  the  problem  of  narrow-band  DOA  estimation  using 
an  ULA,  and  the  time  series  frequency  estimation  prob¬ 
lem,  i.e.,  sinusoids  in  noise  problem.  The  natural- com¬ 
monality  between  these  problems  is  well  known,  how¬ 
ever,  unfortunately  the  analysis  of  these  problems  has 
been  treated  separately.  This  paper  capitalizes  on  the 
analysis  framework  developed  in  [3],  (5).  and  establishes 
an  unified  framework  for  these  problems. 

The  outline  of  the  paper  is  as  follows.  Section  II  pro¬ 
vides  some  background  information.  The  various  covari¬ 
ance  matrix  estimators  are  discussed  and  the  framework 
for  analysis  is  outlined.  Amongst  the  covariance  esti¬ 
mators,  it  is  shown  that  combining  spatial  smoothing  w  ith 
the  forward-backward  approach  is  more  effective  than  us¬ 
ing  forward  spatial  smoothing  alone.  The  statistics  rele¬ 
vant  to  the  analysis  are  derived  under  the  assumption  that 
the  source  amplitudes  and  the  noise  are  independent  and 
are  circularly  Gaussian  random  vectors. 

In  Section  Ill.  an  expression  for  the  mean-squared  error 
(MSE)  in  the  DOA  estimates  obtained  using  eigen-based 
state  space  methods  is  derived.  Some  interesting  proper- 
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Abstract 

Various  methods  for  mapping  signal  processing  algorithms  into  systolic  arrays  have  been  developed 
in  the  past  few  years.  In  this  paper,  efficient  scheduling  techniques  are  developed  for  the  partitioning 
problem,  i.e.  problems  with  size  that  do  not  match  the  array  size.  In  particular,  scheduling  for  the 
Locally  Parallel-Globally  Sequential  (LPGS)  technique  and  the  Locally  Sequential-Globally  Parallel 
(LSGP)  technique  are  developed.  The  scheduling  procedure  developed  exploits  the  fact  that  after 
LPGS  and  LSGP  partitioning ,  the  locality  constraints  are  less  stringent  allowing  for  more  flexibility 
in  the  choice  of  algorithms  and  inter-processor  communication.  A  flexible  scheduling  order  is  devel¬ 
oped  that  is  useful  in  evaluating  the  trade-off  between  execution  time  and  size  of  storage  buffers.  The 
benefits  of  the  scheduling  techniques  are  illustrated  with  the  help  of  matrix  multiplication  and  least 
squares  examples. 
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Abstract 

In  this  paper,  a  new  VQ  coder  is  developed  that  exploits  inter- vector  correlation 
in  a  simple  and  inexpensive  manner.  A  key  and  important  difference  between  the 
suggested  method  and  existing  methods  is  that  it  involves  prediction  of  the  index 
that  is  assigned  to  a  data  vector  as  opposed  to  the  prediction  of  data  vectors. 
Success  of  the  method  depends  on  properly  assigning  the  indices  to  the  codebook 
vectors,  and  for  this  purpose  three  schemes  are  suggested.  This  methodology 
results  in  a  substantia]  reduction  in  the  required  Bit-rate  per  pixel  without  any 
additional  loss  in  image  quality. 
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